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AN  ANALYSIS  OF  TELEOPERATION  WORKEOAD  IN 
VARIOUS  SENSORY  EEEDBACK  MODES 


INTRODUCTION 

The  Teleoperated  Interface  Research  Team  of  the  Soldier-Systems  Control  Branch, 
Human  Research  and  Engineering  Directorate  (HRED)  of  the  U.S.  Army  Research  Eaboratory 
(ARE)  has  been  involved  with  state-of-the-art  teleoperated  vehicles  and  control  systems  of 
various  types  for  scientific  study  and  performance  enhancement.  One  objective  of  the  research 
program  at  ARE  is  to  survey  all  possible  sensory  feedback  modes  and  to  analyze  them  for  their 
sensory  immersion  value,  as  reflected  in  performance  measures  of  speed,  error  rate,  control 
frequency  response,  and  other  stress,  workload,  and  preference  measures.  ARE  is  currently  the 
lead  entity  in  the  Army  that  is  examining  the  optimization  of  teleoperator  performance. 

The  different  feedback  modes  available  for  study  are  stereovision  (allowing  true  depth 
perception),  binaural  feedback  from  microphones  on  the  teleoperated  vehicle,  color  vision, 
expanded  field  of  view  (EOV),  and  simulated  force  feedback.  Other  modes  such  as  low  data  rate 
(foveal  windowing,  reduced  frame  rate,  reduced  resolution,  etc.),  low  bandwidth  audio  (sub¬ 
woofer  frequencies),  and  the  use  of  helmet-mounted  displays  are  being  examined  as  well  but  are 
not  part  of  the  scope  of  this  paper. 

The  impetus  for  modeling  different  sensory  feedback  modes  related  to  teleoperation  began 
with  the  examination  of  manpower-based  system  evaluation  aid  (MAN-SEVAE),  one  of  the 
hardware  and  manpower  (HARDMAN)  III  software  modules.  HARDMAN  III  was  a  major 
development  effort  of  the  Army  Research  Institute’s  (ARI)  System  Research  Eaboratory  and  is 
now  part  of  ARE  (HRED).  MAN-SEVAE  is  part  of  the  HARDMAN  III  Government-owned 
software,  which  consists  of  a  set  of  automated  aids  to  assist  analysts  in  conducting  human 
factors  assessments,  including  manpower,  personnel,  and  training.  MAN-SEVAE  is  a  stochastic 
modeling  environment  that  performs  workload  assessment  analyses  and  manpower  maintenance 
analyses.  The  workload  analysis  is  the  area  of  interest  for  this  paper. 

It  appeared  that  MAN-SEVAE  was  capable  of  being  used  separately  from  the  rest  of  the 
software  modules  as  a  modeling  tool.  The  ability  to  define  functions  (groups  of  related  tasks), 
tasks,  workload  (visual,  cognitive,  psychomotor,  and  auditory),  and  task  times  allowed  the 
layout  and  examination  of  a  workload  and  performance  (time)  model  of  the  basic  teleoperated 
driving  task.  It  was  realized  that  the  tasks  and  workload  could  be  altered,  based  on  projected 
effect  of  different  sensory  feedback  modes.  Therefore,  work  began  to  attempt  to  capture,  in 


3 


MAN-SEVAL,  the  workload  associated  with  different  sensory  feedback  modes.  The  workload 
associated  with  each  (or  a  combination)  of  the  feedback  modes  is  seen  to  be  an  inverse 
relationship  to  performance  in  teleoperated  driving.  In  other  words,  if  the  workload  for  a 
particular  feedback  mode  is  high,  then  the  performance  in  that  feedback  mode  will  tend  to 
improve.  The  performance  of  teleoperated  tasks  is  the  main  research  focus  in  the  Teleoperated 
Interface  Research  Team  at  ARE. 

The  following  is  a  list  of  the  models  built  in  the  MAN-SEVAE  modeling  environment: 
On-board  driving  model  (baseline) 

Teleoperated  modes  (different  sensory  feedback) 

Eow  level  (narrow  EOV,  monoscopic  viewing,  no  audio  or  force  feedback) 

Binaural  feedback 

Simulated  force  feedback  (in  steering  device) 

Wide  EOV  (165o) 

Stereoscopic  vision 
All  feedback  (combined) 

The  recent  increases  in  quantity  and  quality  of  sensory  feedback  modes  are  to  allow  the 
operator  to  drive  at  higher  speeds  and  during  off-road  conditions.  These  technical  challenges 
were  identified  after  Office  of  the  Secretary  of  Defense  demonstration  of  state-of-the-art  robotics 
technology  (OSD  DEMO  I)  as  critical  teleoperator  performance  hurdles.  The  challenge  to 
developing  good  teleoperated  systems  is  the  basic  driving  task,  essential  to  the  delivery  or 
placement  of  the  mission  package;  reconnaissance,  surveillance,  and  target  acquisition  (RSTA); 
chemical  detection;  weapon  system;  or  otherwise. 

ARE  is  currently  pursuing  a  research  effort  during  which  the  sensory  feedback  modes  will 
be  examined  to  determine  monetary  cost,  bandwidth  transmission  requirements,  and  operator 
performance  changes.  However,  before  this  research  effort,  ARE’s  focus  involved  modeling  the 
feedback  modes  and  the  resultant  workload  outcomes  to  form  the  beginnings  of  a  predictive  set  of 
models  with  which  to  project  performance  changes  as  technologies  impact  the  teleoperated 
system. 

The  purpose  of  this  report  is  three-fold: 

1 .  Define  the  functions  and  tasks  of  the  teleoperated  driver, 

2.  Assess  the  teleoperator’s  driving  workload  during  conditions  of  varying  sensory 
feedback,  and 
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3.  Provide  a  possible  prediction  tool  for  the  impact  of  technology  on  teleoperation 
performance.  Discussion  will  also  encompass  recommendations  for  further  modeling 
development. 


TELEOPERATED  DRIVING  MODEE  ANAEYSIS 
Identification  of  Teleoperated  Driving  Eunctions  and  Tasks 

Tasks  are  defined  as  the  smallest  single  work  units,  depending  upon  the  fidelity  of  the 
model,  which  are  “mapped  out”  in  order  to  understand  a  task  network.  Eunctions  are  related 
groups  of  tasks  that  are  required  to  complete  a  part  of  the  overall  job.  Driving  functions  (groups 
of  related  tasks)  were  identified  through  a  task  analysis  of  teleoperated  driving  tasks  with  the 
cooperation  of  resident  ARE  subject  matter  experts  (SMEs)  in  the  area  of  teleoperated  driving 
and  operations.  The  functions  were  then  separated  into  discrete  tasks  (or  relatively  basic 
elements  of  work)  that  were  required  to  complete  the  associated  functions.  All  functions  were 
sequenced  according  to  logical  flow  as  were  all  tasks  associated  with  the  functions.  Task  times 
were  collected  from  a  combination  of  interviews  with  ARE  SMEs  and  the  timing  of  simulated 
events  as  executed  normally  in  driving  operations.  Note.  Dummy  functions  or  tasks  are  those 
non-data-generating  functions  or  tasks  incorporated  into  a  network  to  maintain  proper  structure. 

The  following  teleoperated  driving  functions  were  identified: 

•  Move  to  area  of  operations  (dummy  function) 

•  Conduct  surveillance  (of  driving  scene) 

•  Monitor  vehicle  instruments 

•  Monitor  vehicle  status 

•  Perform  self-recovery 

•  Nothing  happens  (dummy  function) 

•  Steer  vehicle 

•  Power  vehicle 

Table  1  is  a  detailed  list  of  the  functions  and  tasks  identified  to  complete  a  generic  tele¬ 
operated  driving  task.  Dummy  functions  or  dummy  tasks  are  those  which  were  included  but  have 
no  data  to  be  processed  or  generated,  they  are  there  for  the  formation  of  the  model  structure  only. 

It  was  determined  that  the  tasks  in  Table  1  had  to  be  represented  to  a  “deep”  enough  level 
to  be  sensitive  enough  to  and  reflect  possible  changes  in  mission  task  times  and  workload  levels 
influenced  by  different  technologies  in  the  ARE  teleoperated  high  mobility  multipurpose  wheeled 
vehicle  (HMMWV).  The  next  step  in  the  process  was  to  “move”  the  function  and  task  data  into 
the  MAN-SEVAE  environment. 
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Table  1 


Functions  and  Tasks  to  Complete  a  Generic  Teleoperated  Driving  Task 


Functions 


Tasks 


Move  to  area  of  operations  Dummy  function 

Conduct  surveillance  Conduct  surveillance  (dummy  task) 

Detection  of  status  change 
Alerted  by  external  source 
Type  of  change? 

Course  (dummy  task) 

Is  course  in  FOV? 

Course  not  in  FOV 
Alter  vehicle  orientation 
Course  in  FOV 
Search  (dummy  task) 

Visual  (dummy  task) 

Look  up 
Look  down 
Look  left 
Look  right 
Auditory 
Dummy 
ID  course? 

Does  ID  course 

Does  not  ID  course 

On  course 

Not  on  course 

Consult  navigational  aid 

ID  potential  obstacles  and  hazards? 

Does  ID  hazards 

Does  not  ID  hazards 

Hazard  immediate  threat? 

Immediate  threat,  alter  course 

Not  immediate  threat 

Monitor  vehicle  instruments  Monitor  Instruments  (dummy  task) 

Frequent  (dummy  task) 

Infrequent  (dummy  task) 

Monitor  speedometer 
Monitor  tachometer 
Monitor  fuel  level 
Monitor  oil  pressure 
Monitor  engine  temperature 
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Table  1  (continued) 


Monitor  vehicle  status 


Perform  self-recovery 


Nothing  happens 
Steer  vehicle 


Monitor  battery  voltage 
Verify  normal  range 
Normal  range 
Not  normal  range 
Stop  vehicle  and  monitor 

Monitor  vehicle  status  (dummy  task) 

Monitor  vehicle  pitch 

Monitor  vehicle  roll 

Vehicle  attitude  in  normal  range? 

Normal  range 

Not  normal  range 

Stop  vehicle  and  correct  vehicle  attitude 

Monitor  engine  speed 

Engine  speed  in  normal  operation? 

Normal 

Not  normal 

Slow  or  stop  vehicle  and  check 
Monitor  ground  surface 
Ground  surface  suitable  for  travel? 
Suitable 
Not  suitable 

Change  course  (dummy  task) 

Perform  self-recovery 
Need  to  change  direction? 

Change  needed 

Look  to  sides  and  estimate  correction 
Change  not  needed 
Need  to  reverse  direction? 

Reverse  needed 
Look  to  rear,  back  up 
Change  direction 
Reverse  not  needed 
Proceed 

(dummy  function) 

Steer  vehicle  (dummy  task) 

Steer  right 

Steer  left 

Hold  straight 

Let  steering  self-center 

Verify  center  position 

Verify  steering  control  action 


7 


Table  1  (continued) 


Power  vehicle  Power  vehicle  (dummy  task) 

Accelerator  (dummy  task) 
Apply  accelerator 
Hold  accelerator 
Release  accelerator 
Verify  accelerator  action 
Brake  (dummy  task) 

Apply  brake 
Hold  brake 
Release  brake 
Verify  brake  action 


MAN-SEVAL  Modeling 

This  section  describes  how  MAN-SEVAL  is  used.  A  description  of  all  the  steps  required 
to  build,  run,  and  analyze  models  built  in  MAN-SEVAL  follows,  but  first,  a  little  bit  about  the 
major  components  of  the  modeling  software  is  presented. 

MAN-SEVAL  was  used  to  assess  workload  of  the  teleoperated  driving  task.  The  MAN- 
SEVAL  workload  assessment  aid  integrates  two  essential  technologies.  Micro  Saint  software 
simulation  and  the  McCracken- Aldrich  workload  assessment  methodology.  Micro  Saint  (built 
by  Micro  Analysis  &  Design)  is  used  to  build  and  execute  task  network  models  that  simulate 
operational  procedures.  Each  task  within  the  network  is  assigned  to  an  operator.  The 
McCracken- Aldrich  workload  assessment  methodology  is  used  to  assess  the  visual,  auditory, 
cognitive,  and  psychomotor  workload  components  for  each  crew  member.  Each  task  is  assigned 
a  scaled  value  for  each  of  the  four  workload  components.  When  the  simulation  is  run,  the  guard’s 
workload  is  traced  over  time  and  then  graphed.  The  model  allows  easy  identification  of  high  or 
low  workload  periods.  The  McCracken- Aldrich  workload  scales  are  presented  in  Appendix  A  of 
this  report. 

The  steps  for  conducting  a  MAN-SEVAL  workload  analysis  are  as  follow: 

1.  Define  Conditions.  The  conditions  during  which  the  teleoperated  driving  mission  will 
be  performed  are  documented. 

2.  Develop  Eunction  List.  All  possible  functions  that  the  teleoperator  may  perform  are 
listed.  They  are  normally  placed  in  sequence  as  they  would  be  performed  during  actual 
operations. 


3.  Develop  Task  List.  All  possible  tasks  that  the  teleoperator  may  be  required  to 
perform  are  listed  and  sequenced  as  they  would  be  completed  during  actual  operations. 

4.  Identify  Crew  Positions.  The  driver  is  the  only  position  listed. 

5.  Assign  Tasks  to  Jobs.  Two  things  are  done  here.  All  crew  members  capable  of 
performing  each  task  are  identified,  and  then  each  task  is  assigned  to  one  specific  crew  member. 

In  this  analysis,  all  tasks  were  assigned  to  the  teleoperated  driver. 

6.  Define  Performance  Parameters.  Several  things  are  done  here.  All  tasks  are  assigned  a 
most  likely  and  a  fastest  time.  Each  task  is  then  assigned  workload  scale  values  for  visual, 
auditory,  cognitive,  and  psychomotor  workload  channels.  The  workload  scale  values  are  derived 
from  the  McCracken-Aldrich  workload  assessment  methodology.  Finally,  a  high  workload  level 
is  mathematically  defined  by  the  user. 

7.  Execute  Simulation  Run.  Using  Micro  Saint,  the  task  network  simulation  mode  is  run. 

8.  Analyze  Results.  Workload  graphs  depicting  each  crew  member’s  workload  in  each 
workload  channel  are  developed  over  time.  High  workload  tasks  are  displayed  and  can  be 
reallocated  to  other  crew  members  automatically  or  manually  when  possible.  Summary  reports 
(e.g.,  percentage  of  time  a  high  workload  condition  is  experienced  for  each  crew  member)  are  also 
available. 


Estimating  Variance  of  Model  Workloads 

For  each  model  developed,  workload  level  and  task  time  estimates  were  collected  from 
HRED  SMEs  and  from  estimated  scaling  by  using  the  descriptors  of  different  workload  channel 
tasks  as  described  in  the  McCracken-Aldrich  workload  scale  residing  in  the  MAN-SEVAE 
software. 

It  is  especially  important  to  note  that  the  workload  scalings  in  the  McCracken-Aldrich 
workload  rating  system  are  comprised  of  8  points  from  0  through  7,  each  with  a  different  interval 
spacing.  These  workload  ratings  are  established  as  interval  data  and  have  been  validated  by 
leading  workload  experts. 

The  workload  levels  for  each  channel  were  identified  and  set  for  the  first  model  built  or 
the  low  level  feedback  teleoperation  model.  Then,  each  task  in  each  function  was  evaluated  for  a 
potential  in  workload  reduction,  based  on  the  sensory  feedback  being  examined.  If  the  task  was 
identified  as  one  being  affected  by  the  sensory  feedback  technology,  the  workload  level  was 
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adjusted  accordlingly,  either  up  or  down  each  individual  scale.  The  actual  workload  levels  are 
listed  in  Appendix  B.  It  is  equally  important  that  the  reader  understand  that  the  workload 
adjustments  in  each  model  and  the  resultant  output  data  be  treated  as  an  ordinal  relationship. 

This  will  be  mentioned  again  further  in  this  report.  The  potential  problem  with  the  use  of  MAN- 
SEVAL  is  the  forced  usage  of  specific  scale  ratings,  so  that  if  a  task  were  presumed  to  become 
easier,  the  next  lower  workload  value  may  have  been  scaled  lower  in  that  subscale.  Workload 
adjustments  are  subjective  in  nature  and  do  not  carry  the  confidence  of  true  physiological 
workload  data  collection. 


Data  Generation  of  Different  Sensory  Feedback  Modes 

Data  were  generated  from  multiple  runs  of  each  sensory  feedback  model.  Each  model  was 
run  a  total  of  30  iterations.  The  criterion  for  accepting  model  output  for  each  execution  was  that 
the  overall  task  time  be  within  one  standard  deviation  (SD)  of  actual  mean  test  course  completion 
times  for  that  mode  of  operation  (i.e.,  on  board  or  teleoperated).  The  mean  course  completion 
times  were  3  and  6  minutes  for  on-board  and  teleoperated  runs,  respectively.  Data  for  each 
workload  channel  were  collected  in  the  form  of  mean  workload. 

Each  model  was  run  six  times  (30  iterations  per  run)  to  collect  workload  information. 
Workload  channel  data  were  collected  at  1/5-second  intervals,  as  output  in  MAN-SEVAE,  thus 
producing  between  850  and  1800  data  points  for  each  workload  channel,  for  each  run. 


DATA  ANAEYSIS 

Mean  workload  values  for  iterative  model  runs  were  used  as  the  final  data  that  were 
examined  to  determine  if  any  differences  existed  among  the  data.  A  one-way  analysis  of  variance 
(ANOVA),  with  an  F  test  was  used  to  determine  if  there  were  any  significant  differences  among 
the  seven  different  models  run  for  each  of  four  workload  channels  (visual,  auditory,  cognitive,  and 
psychomotor),  as  well  as  overall  workload,  which  was  the  sum  of  all  workload  channels.  A 
Scheffe  post  hoc  test  was  used  to  determine  if  mean  differences  were  significant  between  all 
teleoperated  models  where  significance  dictated. 


RESUETS 

Note.  Before  the  results  of  these  data  are  reviewed,  it  is  important  to  consider  the  results 
of  the  on-board  versus  teleoperated  means  in  the  following  data  sets  if  nonsignificant  differences 
occur.  This  is  so  because  of  the  differences  between  on-board  driving  and  teleoperated  driving. 
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A  nonsignificant  result  is  one  in  which  there  is  marked  similarity  between  the  workload  of  that 
teleoperated  feedback  and  on-board  driving,  which  is  desirable.  However,  among  teleoperated 
means,  significant  differences  are  important  to  note.  Additionally,  when  data  (workload  means) 
are  plotted  or  depicted  graphically,  the  lesser  workload  condition  is  desired. 

The  results  of  data  analysis  for  overall  workload  are  presented  in  Tables  2  through  5. 

Table  2 

F  Test  for  Overall  Workload 


Source 

df 

SS 

F 

s2  ratio 

Critical 

F  value 

Prob. 

F 

Between 

6 

515.39  85.89 

9.89 

2.38  (.05) 

.0000 

Within 

35 

303.73  8.67 

3.38  (.01) 

Total 

41 

819.13 

Table  3 


Multiple  Range  Tests:  Scheffe  Test  With  Significance  Level  .05 


Group 

1 

6  7  2  5  4  3 

(On-board) 

11 

(Wide  FOV) 

61 

(All  feedback) 

71 

(Low  level) 

21 

* 

(stereovision) 

51 

* 

(force  fdbk) 

41 

* 

(binaural) 

31 

* 

The  difference  between  two  means  is  significant  if 

MEAN(J)-MEAN(I)  >=  2.0831  *  RANGE  *  SQRT(1/N(I)  -i-  1/N(J)) 
with  the  following  value(s)  for  RANGE:  5.33 

*Indicates  significant  differences 
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Table  4 


Descriptive  Statistics  for  All  Groups,  Overall  Workload 


Group 

n 

Mean 

Deviation 

Minimum 

Maximum 

On-board 

6 

31.30 

1.07 

30.00 

32.65 

Low  level 

6 

39.18 

3.21 

33.11 

42.69 

Binaural 

6 

42.34 

2.54 

38.49 

45.86 

Force  Fdbk 

6 

40.37 

2.64 

36.42 

44.35 

Stereo 

6 

39.77 

3.75 

33.59 

42.80 

Wide  FOV 

6 

34.97 

1.54 

33.01 

36.49 

All  Fdbk 

6 

36.18 

4.40 

28.89 

41.81 

Table  5 

Homogeneous  Subsets  for  Overall  Workload 

Subset  1 

1,6,7 

Subset  2 

6,7,2,5,4 

Subset  3 

7,2,5,4,3 

The  overall  mean  workload  comparisons  and  homogeneous  groups  for  all  feedback  modes 
are  graphically  depicted  in  Figure  1 . 
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Figure  1.  Mean  and  range  values  for  overall  work  load  with  homogeneous  grouping. 


The  results  of  data  analysis  for  visual  workload  are  presented  in  Tables  6  through  9. 


Table  6 

F  Test  for  Visual  Workload 


Source 

df 

SS 

s2 

E 

ratio 

Critical 

E  value 

Prob. 

E 

Between 

6 

114.65  19.10 

9.15 

2.38  (.05) 

.0000 

Within 

35 

73.05 

2.08 

3.38  (.01) 

Total 

41 

187.71 

Table  7 

Scheffe  Test  With  Significance  Eevel  .05,  Visual  Workload 

Group 

1 

7  6  5  3  2  4 

(On-board) 

11 

(All  feedback) 

71 

(Wide  EOV) 

61 

(binaural) 

51 

* 

(low  level) 

31 

* 

(force  fdbk) 

21 

* 

(Stereo) 

41 

* 

* 

The  difference  between  two  means  is  significant  if 
MEAN(J)-MEAN(I)  >=  1.02  *  RANGE  *  SQRT(1/N(I)  +  1/N(J)) 
with  the  following  value(s)  for  RANGE:  5.33 


*Indicates  significant  differences 
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Table  8 


Descriptive  Statistics  for  All  Groups,  Visual  Workload 


Group  n  Mean  Deviation  Minimum  Maximum 


On-board 

6 

12.11 

.50 

11.38 

12.95 

Low  level 

6 

17.02 

1.98 

13.14 

18.76 

Binaural 

6 

15.62 

.72 

14.56 

16.54 

Force  fdbk 

6 

17.29 

1.50 

14.42 

18.57 

Stereo 

6 

15.50 

1.83 

12.88 

17.32 

Wide  FOV 

6 

15.02 

.69 

13.94 

15.62 

All  fdbk 

6 

13.94 

1.93 

11.31 

16.07 

Table  9 


Homogeneous  Subsets  for  Visual  Workload 


Subset  1 

1,7,6 

Subset  2 

7,6, 5, 3, 2 

Subset  3 

6,5,3,2,4 

The  visual  workload  comparisons  and  homogeneous  groups  for  all  feedback  modes  are 
graphically  depicted  in  Figure  2. 
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Figure  2.  Mean  and  range  values  for  visual  work  load  with  homogeneous  grouping. 


The  results  of  data  analysis  for  auditory  workload  are  presented  in  Tables  10  through  13. 


Table  10 


F  Test  for  Auditory  Workload 


Source 

df 

SS 

s2 

F  Critical 

ratio  F  value 

Prob. 

F 

Between 

6 

75.88 

12.64 

106.24  2.38  (.05) 

.0000 

Within 

35 

4.16 

.11 

3.38  (.01) 

Total 

41 

80.05 

Table  11 


Scheffe  Test  With  Significance  Level  .05,  Auditory  Workload 


Group 

2 

4  5  6  1  7  3 

(force  fdbk) 

21 

(Stereo) 

41 

(binaural) 

51 

(Wide  FOV) 

61 

(On-board) 

11 

(All  feedback) 

71 

(low  level) 

311  * 

***** 

The  difference  between  two  means  is  significant  if 

MEAN(J)-MEAN(I)  >=  .24  *  RANGE  *  SQRT(1/N(I)  -i-  1/N(J)) 
with  the  following  value(s)  for  RANGE:  5.33 

*Indicates  significant  differences 
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Table  12 


Descriptive  Statistics  for  All  Groups,  Auditory  Workload 


Group 

n 

Mean 

Deviation 

Minimum 

Maximum 

On-board 

6 

1.38 

.15 

1.28 

1.68 

Low  level 

6 

1.00 

.00 

1.00 

1.00 

Binaural 

6 

4.95 

.87 

3.80 

6.22 

Force  fdbk 

6 

1.00 

.00 

1.00 

1.00 

Stereo 

6 

1.00 

.00 

1.00 

1.00 

Wide  FOV 

6 

1.00 

.00 

1.00 

1.00 

All  fdbk 

6 

1.00 

.18 

1.43 

1.95 

Table  13 

Homogeneous  Subsets  for  Auditory 

Workload 

Subset  1  2, 4, 5, 6,1 

Subset  2  3 

The  auditory  workload  comparisons  and  homogeneous  groups  for  all  feedback  modes  are 
graphically  depicted  in  Figure  3. 
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Figure  3.  Mean  and  range  values  for  auditory  work  load  with  homogeneous  grouping. 


The  results  of  data  analysis  for  cognitive  workload  are  presented  in  Tables  14  through  17. 


Table  14 

F  Test  for  Cognitive  Workload 


E 

Critical 

Prob. 

Source 

df 

SS 

s2  ratio 

E  value 

E 

Between 

6 

226.20 

37.70  29.73 

2.38  (.05) 

.0000 

Within 

35 

44.37 

1.26 

3.38  (.01) 

Total 

41 

270.57 

Table  15 

Scheffe  Test  With  Significance  Eevel  .05,  Cognitive  Workload 

Group 

1  6 

7  3  4  2 

5 

(On-board) 

11 

(Wide  FOV) 

61 

* 

(All  feedback) 

71 

* 

(Low  level) 

31 

*  * 

(stereovision) 

41 

*  * 

(force  fdbk) 

21 

*  * 

(binaural) 

51 

*  * 

* 

The  difference  between  two  means  is  significant  if 

MEAN(J)-MEAN(I) 

>=  .79  *  RANGE  *  SQRT(1/N(I)  -i-  1/N(J)) 

with  the  following  value(s)  for  RANGE:  5.33 

*Indicates  significant  differences 
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Table  16 


Descriptive  Statistics  for  All  Groups,  Cognitive  Workload 


Group 

n 

Mean 

Deviation 

Minimum 

Maximum 

On-board 

6 

9.39 

.54 

8.89 

10.34 

Low  level 

6 

15.49 

.73 

14.69 

16.81 

Binaural 

6 

14.63 

1.14 

12.82 

15.89 

Force  fdbk 

6 

15.11 

.91 

14.16 

16.79 

Stereo 

6 

16.85 

1.77 

13.86 

18.17 

Wide  FOV 

6 

12.01 

.58 

11.49 

12.85 

All  fdbk 

6 

13.15 

1.55 

10.70 

14.83 

Table  17 

Homogeneous  Subsets  for  Cognitive  Workload 

Subset  1 

1 

Subset  2 

6,7 

Subset  3 

7,3,4,2 

Subset  4 

3,4,2,5 

The  cognitive  workload  comparisons  and  homogeneous  groups  for  all  feedback  modes  are 
graphically  depicted  in  Figure  4. 
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Figure  4.  Mean  and  range  values  for  cognitive  work  load  with  homogeneous  grouping. 


The  results  of  data  analysis  for  psychomotor  workload  are  presented  in  Tables  18 
through  21. 

Table  18 


F  Test  for  Psychomotor  Workload 


Source 

df 

SS 

s2 

E 

ratio 

Critical 

E  value 

Prob. 

E 

Between 

6 

114.65  19.10 

9.15 

2.38  (.05) 

.0000 

Within 

35 

73.05 

2.08 

3.38  (.01) 

Total 

41 

187.71 

Table  19 

Scheffe  Test  With  Significance  Level  .05,  Psychomotor  Workload 

Group 

2  5  6  4  3  7  1 

(force  fdbk)  21 

(binaural)  51 

(Wide  FOV)  61 

(Stereo)  41 

(low  level)  31 

(All  feedback)  71  * 

(On-board)  II  *  * 

The  difference  between  two  means  is  significant  if 
MEAN(J)-MEAN(I)  >=  .52  *  RANGE  *  SQRT(1/N(I)  -i-  1/N(J)) 
with  the  following  value(s)  for  RANGE:  5.33 

*Indicates  significant  differences 
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Table  20 


Descriptive  Statistics  for  All  Groups,  Psychomotor  Workload 


Group 

n 

Mean 

Deviation 

Minimum 

Maximum 

On-board 

6 

8.41 

.10 

8.28 

8.60 

Low-Level 

6 

5.66 

.73 

4.27 

6.41 

Binaural 

6 

7.13 

.54 

6.57 

8.13 

Force  Fdbk 

6 

6.97 

.88 

5.93 

7.97 

Stereo 

6 

6.41 

.47 

5.85 

7.30 

Wide  FOV 

6 

6.96 

.69 

5.85 

8.03 

All  Fdbk 

6 

7.37 

1.25 

5.42 

9.05 

Table  21 

Homogeneous  Subsets  for  Psychomotor  Workload 


Subset  1  2, 5, 6, 4, 3 

Subset  2  5, 6, 4, 3, 7 

Subset  3  6, 4, 3, 7,1 


The  psychomotor  workload  comparisons  and  homogeneous  groups  for  all  feedback 
modes  are  graphically  depicted  in  Figure  5. 
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Figure  5.  Mean  and  range  values  for  psyehomotor  work  load  with  homogeneous  grouping. 


The  results  of  data  analysis  for  number  of  on-going  tasks  workload  are  presented  in 
Tables  22  through  25. 


Table  22 

F  Test  for  Number  of  On-going  Tasks  Workload 


F  Critical  Prob. 

Source  df  SS  s2  ratio  F  value  F 


Between 

6 

2.07 

.34 

4.51 

2.38  (.05) 

.0095 

Within 

35 

1.07 

.07 

3.38  (.01) 

Total 

41 

3.14 

Table  23 


Scheffe  Test  With  Significance  Level  .05,  Number  of  On-going  Tasks  Workload 


Group 

6  2  3  5  4  1  7 

(Wide  FOV) 

61 

(force  fdbk) 

21 

(low  level) 

31 

(binaural) 

51 

(Stereo) 

41 

(On-board) 

11 

(All  feedback) 

71  * 

The  difference  between  two  means  is  significant  if 

MEAN(J)-MEAN(I)  >=  .19  *  RANGE  *  SQRT(1/N(I)  -i-  1/N(J)) 
with  the  following  value(s)  for  RANGE:  5.85 

*Indicates  significant  differences 
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Table  24 


Descriptive  Statistics  for  All  Groups,  Number  of  On-going  Tasks  Workload 


Group 

n 

Mean 

Deviation 

Minimum 

Maximum 

On-board 

6 

5.19 

.01 

5.18 

5.21 

Low  level 

6 

4.64 

.16 

4.54 

4.83 

Binaural 

6 

4.80 

.16 

4.65 

4.97 

Force  fdbk 

6 

4.95 

.22 

4.69 

5.09 

Stereo 

6 

4.88 

.48 

4.40 

5.37 

Wide  FOV 

6 

4.60 

.36 

4.18 

4.85 

All  fdbk 

6 

5.57 

.26 

5.30 

5.82 

Table  25 

Homogeneous  Subsets  for  Number  of  On-going  Tasks  Workload 


Subset  1  6, 2, 3, 5, 4 

Subset  2  2, 3, 5, 4, 1,7 


The  visual  workload  comparisons  and  homogeneous  groups  for  all  feedback  modes  are 
graphically  depicted  in  Figure  6. 


F  Tests 


F  tests  revealed  significant  differences  for  all  workload  channels,  including  overall 
workload  and  number  of  on-going  tasks.  All  ANOVAs  yielded  F  ratios  that  were  significant  to 
the  .Ola  level.  The  Scheffe  Test  was  used  to  perform  group  mean  post  hoc  comparisons: 


Post  Hoc  Analysis 

For  overall  workload,  the  Scheffe  Test  showed  that  on-board  was  significantly  different 
from  low  level,  stereo,  force  feedback  and  binaural  to  the  .05  level.  Wide  field  of  view  was  also 
was  significantly  different  from  binaural  to  the  .05  level.  On-board,  wide  FOV,  and  all  feedback 
conditions  were  not  statistically  different  from  each  other,  and  were  identified  as  a  homogeneous 
group,  where  the  highest  and  lowest  means  are  not  significantly  different. 
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Figure  6.  Mean  and  range  values  for  number  of  on-going  tasks  with  homogeneous  grouping. 


For  visual  workload,  the  Scheffe  Test  showed  that  on-board  was  significantly  different 
from  low  level,  stereo,  force  feedback,  and  binaural  to  the  .05  level.  All  feedback  was  also  was 
significantly  different  from  force  feedback  to  the  .05  level.  On-board,  wide  FOV,  and  all 
feedback  conditions  were  not  statistically  different  from  each  other  and  were  identified  as  a 
homogeneous  group,  in  which  the  highest  and  lowest  means  are  not  significantly  different. 

For  auditory  workload,  the  Scheffe  Test  showed  that  binaural  feedback  was  significantly 
different  from  all  other  conditions  to  the  .05  level. 

For  cognitive  workload,  the  Scheffe  Test  showed  that  on-board  was  significantly 
different  from  all  other  conditions  to  the  .05  level.  Wide  field  of  view  was  also  was  significantly 
different  from  binaural,  force  feedback,  low  level,  and  stereo  to  the  .05  level.  Additionally,  all 
feedback  was  significantly  different  from  stereo  to  the  .05  level.  Wide  FOV  and  all  feedback 
conditions  were  not  statistically  different  from  each  other  and  were  identified  as  a  homogeneous 
group,  in  which  the  highest  and  lowest  means  are  not  significantly  different.  On-board  was 
identified  as  a  single  homogeneous  group. 

For  psychomotor  workload,  the  Scheffe  Test  showed  that  low  level  was  significantly 
different  from  all  feedback  and  on-board  to  the  .05  level.  Stereo  was  also  was  significantly 
different  from  on-board  to  the  .05  level.  On-board,  binaural,  force  feedback,  and  wide  field  of 
view  conditions  were  not  statistically  different  from  each  other  and  were  identified  as  a 
homogeneous  group,  in  which  the  highest  and  lowest  means  are  not  significantly  different. 

For  number  of  on-going  tasks,  the  Scheffe  Test  showed  that  wide  field  of  view  was 
significantly  different  from  all  feedback  to  the  .05  level.  All  feedback,  on-board,  force  feedback, 
stereo,  binaural,  and  low  level  conditions  were  not  statistically  different  from  each  other  and 
were  identified  as  a  homogeneous  group,  in  which  the  highest  and  lowest  means  are  not 
significantly  different. 


CONCLUSIONS 

Upon  examination  of  the  F  Test  results  and  the  post  hoc  mean  comparisons  of  the 
different  model  group  means,  it  can  be  seen  that  a  definite  trend  occurred  in  the  data.  It  appears 
that  the  data  for  wide  FOV  and  the  all  feedback  models  were  similar  to  those  of  on-board  driving 
with  respect  to  overall  and  visual  workload.  Additionally,  wide  FOV  and  all  feedback  were 
significantly  different  from  the  other  teleoperated  feedback  (binaural,  force  feedback,  low  level. 
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and  stereo),  even  though  different  from  on-board  data  for  cognitive  workload.  The  best  evidence 
of  this  is  seen  by  examining  the  graphical  representations  of  the  data  (see  Figures  1  through  6). 

The  reason  for  the  similarities  of  the  modeled  data  among  on-board,  wide  FOV,  and  all 
feedback  models  appears  to  be  because  of  the  number  of  tasks  that  are  affected  by  the  feedback. 
The  feedback  qualities  of  the  modeled  conditions  are  similar  because  of  the  task  workload 
similarity.  Using  the  on-board  model  as  a  baseline  comparison,  wide  FOV  and  all  feedback  data 
seem  to  be  worth  examining  through  the  use  of  further  modeling  and  model  validation  via  field 
data  collection  during  teleoperated  driving  conditions. 

The  author  believes  that  the  utility  of  the  wide  FOV  and  of  course,  the  all  feedback 
models,  is  for  the  most  part,  supported  by  the  relevant  scientific  literature.  The  all  feedback 
model  is  of  particular  concern  for  future  modeling  efforts  because  of  the  potentially  strong  effect 
of  combining  all  possible  feedback  modes. 

The  author  further  believes  that  the  modeled  combination  of  all  feedback  modes,  except 
for  binaural  (auditory)  feedback,  would  have  yielded  stronger  results  beyond  those  reflected  for 
wide  field  of  view  and  all  feedback  combined.  This  hypothesized  effect  is  expected  because  of  the 
relatively  high  overall  workload  seen  in  the  binaural  feedback  condition. 

In  the  future,  factorial  analysis  of  the  effects  of  different  combinations  of  sensory 
feedback  modes  will  benefit  those  teleoperated  systems  developers  looking  for  the  right  mix  of 
sensory  feedback,  for  the  particular  task  needs  of  the  system.  It  is  believed  that  in  order  to  learn 
more  about  the  interaction  effects  of  all  feedback  scenarios,  a  factorial  design  or  a  specially 
selected  set  of  feedback  combinations  for  workload  comparison  should  be  tried  in  the  future. 

Overall,  the  confidence  in  the  “generality”  of  the  overall  workload  data  is  high,  because  of 
the  examination  of  workload  for  each  operator  task  and  the  common  sense  approach  to  sensory 
feedback  modes.  However,  specific  workload  data  to  be  used  for  the  purpose  of  equipment 
design  or  fabrication  would  be  foolhardy  without  model  validation  through  the  comparison  of  real 
workload  data. 

RECOMMENDATIONS  EOR  EURTHER  RESEARCH  AND  DEVEEOPMENT 

A.  Collect  real  task  times  from  soldiers  in  the  user  population. 
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To  enhance  the  fidelity  of  the  models  herein  and  in  the  future,  it  is  suggested  that  task 
times  to  be  included  in  the  MAN-SEVAL  models  be  collected  from  a  large  pool  of  actual  system 
users.  The  task  times  from  the  larger  pool  of  real  users  should  prove  to  be  more  stable  estimates. 
A  current  ARE  effort  with  the  project  manager  of  unmanned  ground  vehicles  (PMUGV)  will 
accomplish  this. 

B.  Verify  the  workload  ratings  of  teleoperated  tasks  in  MAN-SEVAE. 

A  truer  method  of  estimating  workload  from  different  types  of  tasks  should  be  included 
in  the  McCracken- Aldrich  workload  scales.  A  listing  of  all  teleoperated  tasks  as  they  relate 
precisely  to  the  workload  scales  should  be  developed  for  future  modeling.  Presently,  tasks  must 
be  identified  and  a  similar  but  not  exact  task  is  given  in  the  workload  scales.  This  would  require 
the  consultation  of  a  workload  expert. 

C.  Performing  Maintenance  and  RSTA  mission  modeling. 

RSTA  should  be  examined  in  future  modeling  efforts  to  provide  a  more  complete 
approach  to  the  area  of  teleoperated  mission  and  payload  operation. 

Additionally,  it  has  been  suggested  that  a  maintenance  workload  and  task  time  model  be 
developed  along  with  mission-oriented  clothing  restrictions  as  variations  of  the  maintenance 
models  (mission-oriented  protective  posture  [MOPP]  and  arctic  clothing).  This  will  be 
performed  in  the  near  future  by  ARE  to  support  PMUGV  efforts. 

D.  Develop  a  common  workload  measure  for  data  transfer  from  experimental  to  modeling 
environments. 

Compare  any  experimental  data  findings  with  modeled  predictions  to  determine  if  the 
modeling  effort  established  in  this  report  can  be  validated  or  verified.  This  may  also  encompass 
the  use  of  a  workload  rating  system  such  as  the  National  Aeronautics  and  Space  Administration 
(NASA)  task  load  index  (TEX)  or  other  measures  to  successfully  capture  the  four  channels  of 
workload  as  used  in  MAN-SEVAE.  NASA  TEX  data  can  be  transformed  into  “overall 
workload”  data.  However,  there  is  no  direct  or  standardized  workload  format.  Such  a  format  is 
needed  to  transfer  common  workload  measures  from  the  experimental  situation  into  the  modeling 
situation. 

An  effort  to  begin  investigation  in  this  area,  which  will  be  fostered  by  a  Phase  II  small 
business  innovative  research  (SBIR)  contract,  is  progressing  at  ARE. 
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APPENDIX  A 

MCCRACKEN- ALDRICH  WORKLOAD  SCALES 
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MCCRACKEN- ALDRICH  WORKLOAD  SCALES 


Scale  Value 

0.0 

1.0 

3.7 

4.0 

5.0 

5.4 

5.9 

7.0 


0.0 

1.0 

1.2 

3.7 

4.6 
5.3 

6.8 
7.0 

0.0 

1.0 

2.0 

4.2 

4.3 
4.9 

6.6 
7.0 

0.0 

1.0 

2.2 

2.6 

4.6 

5.8 

6.5 

7.0 


McCracken- Aldrich  Scale  Values 


Descriptor  Scale 

No  Visual  Activity  Visual 

Visually  Register/Detect  (detect  occurrence  of  image) 

Visually  Discriminate  (detect  visual  difference) 

Visually  Inspect/Check  (discrete  inspection/static  condition) 

Visually  Locate/ Align  (selective  orientation) 

Visually  Track/Lollow  (maintain  orientation) 

Visually  Read  (symbol) 

Visually  Scan/Search/Monitor  (continuous/serial  inspection, 
multiple  conditions) 

No  Cognitive  Activity  Cognitive 

Automatic  (simple  association) 

Alternative  selection 
Sign/Signal  Recognition 
Evaluation/Judgment  (consider  single  aspect) 

Encoding/Decoding,  Recall 
Evaluation/Judgment  (consider  several  aspects) 

Estimation,  Calculation,  Conversion 

No  Auditory  Activity  Auditory 

Detect/Register  Sound  (detect  occurrence  of  sound) 

Orient  to  Sound  (general  orientation/attention) 

Orient  to  Sound  (selective  orientation/attention) 

Verify  Auditory  Eeedback  (detect  occurrence  of  anticipated  sound) 

Interpret  Semantic  Content  (speech) 

Discriminate  Sound  Characteristics  (detect  auditory  differences) 

Interpret  Sound  Patterns  (pulse  rates,  etc.) 

No  Psychomotor  Activity  Psychomotor 

Speech 

Discrete  Actuation  (button,  toggle,  trigger) 

Continuous  Adjustive  (flight  control,  sensor  control) 

Manipulative 

Discrete  Adjustive  (rotary,  vertical  thumb  wheel,  lever  position) 

Symbolic  Production  (writing) 

Serial  Discrete  Manipulation  (keyboard  entries) 
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APPENDIX  B 

WORKLOAD  BREAKDOWN  BY  SENSORY  EEEDBACK  TYPE 
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WORKLOAD  BREAKDOWN  BY  SENSORY  EEEDBACK  TYPE 


Key: 

OB  -  On-Board  Driving  EE  -  Eow  Eevel  Eeedback  BI  -  Binaural  Eeedback 

EE  -  Eorce  Eeedback  ST  -  Stereo  Vision  WE  -  Wide  Eield  of  View 

AE  -  All  Eeedback  Combined 

Note.  In  the  following  tables,  blank  data  spaces  signify  data  from  the  Eow  Eevel  Eeedback 
condition  that  did  not  change  as  a  result  of  the  sensory  feedback  mode. 


Function  It  Move  to  Area  of  Operations  (dummy  function) 


Function  2:  Conduct  Surveillance 


Tasks: 

1.  Conduct  Surveillance  (dummy) 


2.  Detection  of  Status  Change 

AUD 

LL 

OB 

BI 

FF 

ST 

WF 

AF 

COG 

PSYM 

4.6 

3.7 

4.6 

VIS 

3.7 

1 

3.7 

Most  Likely  Time  to  Complete  (s) 

1.5 

1.0 

1.2 

1.2 

Fastest  Time  to  Compete  (s) 

1.2 

.6 

1.0 

1.0 

3.  Alerted  by  External  Source 

LL 

OB 

BI 

FF 

ST 

WF 

AF 

AUD 

4.7 

4.7 

COG 

PSYM 

4.6 

3.7 

3.7 

3.7 

VIS 

5 

3.7 

5 

5 

Most  Likely  Time  to  Complete  (s) 

1.2 

1.0 

1.2 

Fastest  Time  to  Compete  (s) 

1.0 

.6 

1.0 

4.  Type  of  Change  (dummy) 

5.  Course  (dummy) 

6.  Is  Course  in  FOV? 

AUD 

LL 

OB 

BI 

FF 

ST 

WF 

AF 

COG 

PSYM 

6.8 

3.7 

6.8 

4.6 

4.6 

VIS 

7 

3.7 

5 

5.4 

5 

Most  Likely  Time  to  Complete  (s) 

1.2 

1.0 

1.0 

1.0 

Fastest  Time  to  Compete  (s) 

1.0 

.6 

.9 

.9 

7.  Course  Not  in  FOV 

AUD 

LL 

OB 

BI 

FF 

ST 

WF 

AF 

COG 

PSYM 

6.8 

3.7 

6.8 

4.6 

4.6 

VIS 

7 

3.7 

5 

5.4 

5 

Most  Likely  Time  to  Complete  (s) 

1.5 

1.0 

1.2 

1.0 

1.0 

Fastest  Time  to  Compete  (s) 

1.2 

.6 

1.0 

.9 

.9 
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8.  Alter  Vehicle  Orientation 

AUD 

LL 

OB 

BI 

FF 

ST 

WF 

AF 

COG 

6.8 

3.7 

5.3 

5.3 

PSYM 

2.6 

1 

2.6 

2.6 

VIS 

5.4 

3.7 

5.4 

5.4 

Most  Likely  Time  to  Complete  (s) 

4.8 

2.5 

4.8 

Fastest  Time  to  Compete  (s) 

2.5 

1.0 

2.5 

9.  Course  in  FOV  (dummy) 

10.  Search  (dummy) 

11.  Visual  (dummy) 

12.  Lookup 

AUD 

LL 

OB 

BI 

FF 

ST 

WF 

AF 

COG 

6.8 

3.7 

5.3 

4.6 

4.6 

PSYM 

1 

1 

1 

1 

1 

VIS 

7 

3.7 

5.9 

5.4 

5.4 

Most  Likely  Time  to  Complete  (s) 

1.5 

1.0 

1.2 

1.0 

1.0 

Fastest  Time  to  Compete  (s) 

1.2 

.6 

1.0 

.9 

.9 

13.  Look  Down 

AUD 

LL 

OB 

BI 

FF 

ST 

WF 

AF 

COG 

6.8 

3.7 

5.3 

4.6 

4.6 

PSYM 

1 

1 

1 

1 

1 

VIS 

7 

3.7 

5.9 

5.4 

5.4 

Most  Likely  Time  to  Complete  (s) 

1.5 

1.0 

1.2 

1.0 

1.0 

Fastest  Time  to  Compete  (s) 

1.2 

.6 

1.0 

.9 

.9 

14.  Look  Left 

AUD 

LL 

OB 

BI 

FF 

ST 

WF 

AF 

COG 

6.8 

3.7 

5.3 

4.6 

4.6 

PSYM 

1 

1 

1 

1 

1 

VIS 

7 

3.7 

5.9 

5.4 

5.4 

Most  Likely  Time  to  Complete  (s) 

1.5 

1.0 

1.2 

1.0 

1.0 

Fastest  Time  to  Compete  (s) 

1.2 

.6 

1.0 

.9 

.9 

15.  Look  Right 

AUD 

LL 

OB 

BI 

FF 

ST 

WF 

AF 

COG 

6.8 

3.7 

5.3 

4.6 

4.6 

PSYM 

1 

1 

1 

1 

1 

VIS 

7 

3.7 

5.9 

5.4 

5.4 

Most  Likely  Time  to  Complete  (s) 

1.5 

1.0 

1.2 

1.0 

1.0 

Fastest  Time  to  Compete  (s) 

1.2 

.6 

1.0 

.9 

.9 

16.  Auditory 

LL 

OB 

BI 

FF 

ST 

WF 

AF 

AUD 

2 

2 

COG 

PSYM 

VIS 

1 

1 

Most  Likely  Time  to  Complete  (s) 

1.2 

1.0 

1.2 

Fastest  Time  to  Compete  (s) 

1.0 

.6 

1.0 

17.  Dummy 
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18.  ID  Course? 


LL 

AUD 

COG  6.8 

PSYM 
VIS  5 

Most  Likely  Time  to  Complete  (s)  1.5 

Fastest  Time  to  Compete  (s)  1.2 

19.  Does  ID  Course  LL 

AUD 

COG  6.8 

PSYM 

VIS  5 

Most  Likely  Time  to  Complete  (s)  1.5 

Fastest  Time  to  Compete  (s)  1.2 

20.  Does  Not  ID  Course  LL 

AUD 

COG  6.8 

PSYM 

VIS  5 

Most  Likely  Time  to  Complete  (s)  1.5 

Fastest  Time  to  Compete  (s)  1.2 

21.  On  Course  LL 


AUD 

COG 

PSYM 

VIS 


Most  Likely  Time  to  Complete  (s)  1.5 

Fastest  Time  to  Compete  (s)  1.2 

22.  Not  on  Course  LL 

AUD 

COG  6.8 

PSYM 

VIS  5.4 

Most  Likely  Time  to  Complete  (s)  1.5 

Fastest  Time  to  Compete  (s)  1.2 

23.  Consult  Navigational  Aid  LL 

AUD 

COG  7 

PSYM 

VIS  7 

Most  Likely  Time  to  Complete  (s)  1.2 

Fastest  Time  to  Compete  (s)  1.0 

24.  ID  Potential  Obstacles/Hazards?  LL 

AUD 

COG  6.8 

PSYM 

VIS  7 

Most  Likely  Time  to  Complete  (s)  1.5 

Fastest  Time  to  Compete  (s)  1.2 


OB 

BI 

FF 

ST 

WF 

AF 

3.7 

5.3 

4.6 

4.6 

3.7 

5 

5.4 

5 

1.0 

1.2 

1.0 

1.0 

.6 

1.0 

.9 

.9 

OB 

BI 

FF 

ST 

WF 

AF 

3.7 

4.6 

4.6 

4.6 

3.7 

5 

5.4 

5 

1.0 

1.2 

1.0 

1.0 

.6 

1.0 

.9 

.9 

OB 

BI 

FF 

ST 

WF 

AF 

3.7 

4.6 

4.6 

4.6 

3.7 

5 

5.4 

5 

1.0 

1.2 

1.0 

1.0 

.6 

1.0 

.9 

.9 

OB 

BI 

FF 

ST 

WF 

AF 

1.0 

1.2 

1.0 

1.0 

.6 

1.0 

.9 

.9 

OB 

BI 

FF 

ST 

WF 

AF 

3.7 

4.6 

4.6 

3.7 

5.4 

5.4 

1.0 

1.2 

1.0 

1.0 

.6 

1.0 

.9 

.9 

OB 

BI 

FF 

ST 

WF 

AF 

3.7 

7 

7 

7 

1.0 

1.2 

.6 

1.0 

OB 

BI 

FF 

ST 

WF 

AF 

2 

2 

3.7 

6.8 

4.6 

4.6 

5.9 

5.4 

5.9 

5.9 

1.0 

1.2 

1.2 

.6 

1.0 

1.0 
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25.  Does  ID  Hazards 


AUD 

COG 

PSYM 

VIS 

Most  Likely  Time  to  Complete  (s) 

Fastest  Time  to  Compete  (s) 

26.  Does  Not  ID  Hazards 

AUD 

COG 

PSYM 

VIS 

Most  Likely  Time  to  Complete  (s) 

Fastest  Time  to  Compete  (s) 

27.  Hazard  Immediate  Threat? 

AUD 

COG 

PSYM 

VIS 

Most  Likely  Time  to  Complete  (s) 

Fastest  Time  to  Compete  (s) 

28.  Immediate  Threat,  Alter  Course 

AUD 

COG 

PSYM 

VIS 

Most  Likely  Time  to  Complete  (s) 

Fastest  Time  to  Compete  (s) 

29.  Not  Immediate  Threat 

AUD 

COG 

PSYM 

VIS 


LL 

OB 

BI 

FF 

ST 

WF 

AF 

2 

2 

6.8 

3.7 

6.8 

4.6 

4.6 

7 

5.9 

5.4 

5.9 

5.4 

1.5 

1.0 

1.2 

1,2 

1.2 

.6 

1.0 

1.0 

LL 

OB 

BI 

FF 

ST 

WF 

AF 

2 

2 

6.8 

3.7 

6.8 

4.6 

4.6 

7 

5.9 

5.4 

5.9 

5.4 

1.5 

1.0 

1.2 

1.2 

1.2 

.6 

1.0 

1.0 

LL 

OB 

BI 

FF 

ST 

WF 

AF 

2 

2 

6.8 

3.7 

6.8 

4.6 

4.6 

7 

5.9 

5.4 

5.9 

5.4 

1.2 

1.0 

1.0 

1.0 

1.0 

.6 

.9 

.9 

LL 

OB 

BI 

FF 

ST 

WF 

AF 

2 

2 

7 

3.7 

4.6 

4.6 

2.6 

2.6 

2.6 

2.6 

3.5 

1.8 

3.5 

1.5 

.9 

1.5 

LL 

OB 

BI 

FF 

ST 

WF 

AF 

2 

2 

7 

3.7 

4.6 

4.6 

Function  3:  Monitor  Vehicle  Instruments 
Tasks: 

1.  Monitor  Instruments  (dummy) 


2.  Frequent  (dummy) 

3.  Infrequent  (dummy) 

4.  Monitor  Speedometer 

AUD 

LL 

OB 

BI 

FF 

ST 

WF 

AF 

COG 

PSYM 

5.3 

5.3 

VIS 

4 

4 

5.  Monitor  Tachometer 

AUD 

LL 

OB 

BI 

FF 

ST 

WF 

AF 

COG 

PSYM 

5.3 

5.3 

VIS 

4 

4 
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6.  Monitor  Fuel  Level 

AUD 

LL 

OB 

BI 

FF 

ST 

WF 

AF 

COG 

PSYM 

4.6 

4.6 

VIS 

4 

4 

7.  Monitor  Oil  Pressure 

AUD 

LL 

OB 

BI 

FF 

ST 

WF 

AF 

COG 

PSYM 

4.6 

4.6 

VIS 

4 

4 

8.  Monitor  Engine  Temperature 

AUD 

LL 

OB 

BI 

FF 

ST 

WF 

AF 

COG 

PSYM 

4.6 

4.6 

VIS 

4 

4 

9.  Monitor  Battery  Voltage 

AUD 

LL 

OB 

BI 

FF 

ST 

WF 

AF 

COG 

PSYM 

4.6 

4.6 

VIS 

4 

4 

10.  Verify  Normal  Range 

AUD 

LL 

OB 

BI 

FF 

ST 

WF 

AF 

COG 

PSYM 

4.6 

4.6 

VIS 

4 

4 

11.  Normal  Range 

AUD 

LL 

OB 

BI 

FF 

ST 

WF 

AF 

COG 

PSYM 

4.6 

4.6 

VIS 

4 

4 

12.  Not  Normal  Range 

AUD 

LL 

OB 

BI 

FF 

ST 

WF 

AF 

COG 

PSYM 

4.6 

4.6 

VIS 

4 

4 

13.  Stop  Vehicle  and  Monitor 

AUD 

LL 

OB 

BI 

FF 

ST 

WF 

AF 

COG 

1.2 

1.2 

1.2 

PSYM 

2.2 

2.2 

VIS 

7.0 

3.7 

7.0 

Most  Likely  Time  to  Complete  (s) 

10.0 

5.0 

10.0 

Fastest  Time  to  Compete  (s) 

7.0 

1.8 

7.0 
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Function  4:  Monitor  Vehicle  Status 


Tasks: 

1.  Monitor  Vehicle  Status  (dummy) 


Monitor  Vehicle  Pitch 

AUD 

LL 

OB 

BI 

FF 

ST 

WF 

AF 

COG 

PSYM 

6.8 

1 

4.6 

4.6 

VIS 

5 

3.7 

5 

5 

Most  Likely  Time  to  Complete  (s) 

1.8 

1.0 

1.3 

1.3 

Fastest  Time  to  Compete  (s) 

1.2 

.6 

1.0 

1.0 

Monitor  Vehicle  Roll 

AUD 

LL 

OB 

BI 

FF 

ST 

WF 

AF 

COG 

PSYM 

6.8 

1 

4.6 

4.6 

VIS 

5 

3.7 

5 

5 

Most  Likely  Time  to  Complete  (s) 

1.8 

1.0 

1.3 

1.3 

Fastest  Time  to  Compete  (s) 

1.2 

.6 

1.0 

1.0 

Vehicle  Attitude  in  Normal  Range? 

LL 

OB 

BI 

FF 

ST 

WF 

AF 

AUD 

COG 

6.8 

1 

4.6 

4.6 

PSYM 

VIS 

5 

3.7 

5 

5 

Most  Likely  Time  to  Complete  (s) 

2.4 

1.0 

2.4 

Fastest  Time  to  Compete  (s) 

1.2 

.6 

1.2 

Normal 

LL 

OB 

BI 

FF 

ST 

WF 

AF 

AUD 

4.3 

1 

1 

COG 

4.6 

4.6 

4.6 

4.6 

PSYM 

VIS 

5.9 

5.9 

5.9 

5.9 

Most  Likely  Time  to  Complete  (s) 

1.6 

1.0 

1.6 

Fastest  Time  to  Compete  (s) 

1.2 

.6 

1.2 

Not  Normal 

LL 

OB 

BI 

FF 

ST 

WF 

AF 

AUD 

4.3 

1 

1 

COG 

4.6 

4.6 

4.6 

4.6 

PSYM 

VIS 

5.9 

5.9 

5.9 

5.9 

Most  Likely  Time  to  Complete  (s) 

1.6 

1.0 

1.6 

Fastest  Time  to  Compete  (s) 

1.2 

.6 

1.2 

Stop  Vehicle,  Correct  Vehicle  Attitude 

AUD 

LL 

OB 

BI 

FF 

ST 

WF 

AF 

COG 

6.8 

4.6 

6.8 

PSYM 

2.6 

2.6 

2.6 

VIS 

5.4 

3.7 

5.4 

Most  Likely  Time  to  Complete  (s) 

18.0 

12.0 

18.0 

Fastest  Time  to  Compete  (s) 

15.0 

6.0 

15.0 
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8.  Monitor  Engine  Speed 

LL 

OB 

BI 

FF 

ST 

WF 

AF 

AUD 

4.3 

1 

1 

COG 

PSYM 

3.7 

3.7 

3.7 

3.7 

VIS 

5.9 

5.9 

5.9 

5.9 

Most  Likely  Time  to  Complete  (s) 

1.6 

1.0 

1.2 

1.2 

Fastest  Time  to  Compete  (s) 

1.2 

.6 

1.0 

1.0 

9.  Engine  Speed  in  Normal  Operation? 

LL 

OB 

BI 

FF 

ST 

WF 

AF 

AUD 

4.3 

1 

1 

COG 

PSYM 

4.6 

3.7 

4.6 

VIS 

5.9 

5.9 

5.9 

Most  Likely  Time  to  Complete  (s) 

1.6 

1.0 

1.2 

1.2 

Fastest  Time  to  Compete  (s) 

1.2 

.6 

1.0 

1.0 

10.  Normal 

LL 

OB 

BI 

FF 

ST 

WF 

AF 

AUD 

4.3 

1 

1 

COG 

PSYM 

4.6 

4.6 

4.6 

4.6 

VIS 

5.9 

5.9 

5.9 

5.9 

Most  Likely  Time  to  Complete  (s) 

1.6 

1.0 

1.2 

1.2 

Fastest  Time  to  Compete  (s) 

1.2 

.6 

1.0 

1.0 

11.  Not  Normal 

LL 

OB 

BI 

FF 

ST 

WF 

AF 

AUD 

4.3 

1 

1 

COG 

PSYM 

4.6 

4.6 

4.6 

4.6 

VIS 

5.9 

5.9 

5.9 

5.9 

Most  Likely  Time  to  Complete  (s) 

1.6 

1.0 

1.2 

1.2 

Fastest  Time  to  Compete  (s) 

1.2 

.6 

1.0 

1.0 

12.  Slow  or  Stop  Vehicle  and  Check 

AUD 

LL 

OB 

BI 

FF 

ST 

WF 

AF 

COG 

1.2 

1.2 

PSYM 

VIS 

2.6 

2.6 

13.  Monitor  Ground  Surface 

LL 

OB 

BI 

FF 

ST 

WF 

AF 

AUD 

4.3 

4.3 

4.3 

COG 

3.7 

3.7 

3.7 

3.7 

PSYM 

VIS 

4 

3.7 

5 

4 

Most  Likely  Time  to  Complete  (s) 

1.6 

1.2 

1.0 

1.0 

Fastest  Time  to  Compete  (s) 

1.2 

1.0 

.9 

.9 

14.  Ground  Surface  Suitable  for  Travel? 

LL 

OB 

BI 

FF 

ST 

WF 

AF 

AUD 

4.3 

4.3 

4.3 

COG 

6.8 

3.7 

4.6 

5.3 

4.6 

PSYM 

VIS 

4 

3.7 

4 

4 

4 

Most  Likely  Time  to  Complete  (s) 

1.6 

1.2 

1.0 

1.0 

Fastest  Time  to  Compete  (s) 

1.2 

1.0 

.9 

.9 
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15.  Suitable 


LL 

OB 

BI 

FF 

ST 

WF  AF 

AUD 

4.3 

4.3 

4.3 

COG 

PSYM 

6.8 

3.7 

4.6 

5.3 

4.6 

VIS 

4 

3.7 

4 

4 

4 

Most  Likely  Time  to  Complete  (s) 

1.6 

1.2 

1.0 

1.0 

Fastest  Time  to  Compete  (s) 

1.2 

1.0 

.9 

.9 

Not  Suitable 

LL 

OB 

BI 

FF 

ST 

WF 

AF 

AUD 

4.3 

4.3 

4.3 

COG 

6.8 

3.7 

4.6 

5.3 

4.6 

PSYM 

VIS 

4 

3.7 

4 

4 

4 

Most  Likely  Time  to  Complete  (s) 

1.6 

1.2 

1.0 

1.0 

Fastest  Time  to  Compete  (s) 

1.2 

1.0 

.9 

.9 

Change  Course 

AUD 

LL 

OB 

BI 

FF 

ST  WF 

AF 

COG 

1 

1 

1 

PSYM 

2.6 

2.6 

2.6 

VIS 

5.4 

3.7 

5.4 

Most  Likely  Time  to  Complete  (s) 

3.0 

1.5 

3.0 

Fastest  Time  to  Compete  (s) 

1.2 

1 

1.2 

18.  (dummy) 


Function  5:  Perform  Self  Recovery 
Tasks: 


Perform  Self-Recovery 

AUD 

LL 

OB 

BI 

FF 

ST 

WF 

AF 

COG 

6.8 

3.7 

4.6 

4.6 

PSYM 

4.6 

2.6 

2.6 

VIS 

7 

5 

5.4 

5.4 

Need  to  Change  Direction? 

AUD 

LL 

OB 

BI 

FF 

ST 

WF 

AF 

COG 

7 

3.7 

5.3 

4.6 

4.6 

PSYM 

VIS 

7 

5 

5.4 

7 

5.4 

Most  Likely  Time  to  Complete  (s) 

1.8 

1.0 

1.2 

1.2 

Fastest  Time  to  Compete  (s) 

1.2 

.6 

1.0 

1.0 

Change  Needed  (dummy) 

Look  to  Sides  Estimate  Correction 

AUD 

LL 

OB 

BI 

FF 

ST 

WF 

AF 

COG 

6.8 

3.7 

5.3 

4.6 

4.6 

PSYM 

1 

1 

1 

1 

1 

VIS 

7 

5 

5.4 

7 

5.4 

Most  Likely  Time  to  Complete  (s) 

1.4 

1.0 

1.0 

1.0 

Fastest  Time  to  Compete  (s) 

1.25 

.6 

.9 

.9 

48 


5.  Change  Not  Needed 

AUD 

LL 

OB 

BI 

FF 

ST 

WF 

AF 

COG 

PSYM 

VIS 

1.2 

1.2 

Most  Likely  Time  to  Complete  (s) 

1.8 

1.0 

1.8 

Fastest  Time  to  Compete  (s) 

1.2 

.6 

1.2 

6.  Need  to  Reverse  Direction? 

AUD 

LL 

OB 

BI 

FF 

ST 

WF 

AF 

COG 

PSYM 

VIS 

1.2 

1.2 

Most  Likely  Time  to  Complete  (s) 

1.2 

1.0 

1.2 

Fastest  Time  to  Compete  (s) 

1.2 

.6 

1.2 

7.  Reverse  Needed 

AUD 

LL 

OB 

BI 

FF 

ST 

WF 

AF 

COG 

PSYM 

VIS 

1.2 

1.2 

Most  Likely  Time  to  Complete  (s) 

1.2 

1.0 

1.2 

Fastest  Time  to  Compete  (s) 

1.2 

.6 

1.2 

8.  Look  to  Rear,  Back-up 

AUD 

LL 

OB 

BI 

FF 

ST 

WF 

AF 

COG 

6.8 

3.7 

5.3 

5.3 

PSYM 

2.6 

2.6 

VIS 

7 

5 

5.4 

5.4 

Most  Likely  Time  to  Complete  (s) 

14.0 

6.0 

10.0 

10.0 

Fastest  Time  to  Compete  (s) 

8.0 

3.0 

5.0 

5.0 

9.  Change  Direction 

AUD 

LL 

OB 

BI 

FF 

ST 

WF 

AF 

COG 

1.2 

1.2 

PSYM 

VIS 

2.6 

2.6 

Most  Likely  Time  to  Complete  (s) 

4.2 

2.0 

3.0 

3.0 

Fastest  Time  to  Compete  (s) 

2.0 

.9 

1.5 

1.5 

10.  Reverse  Not  Needed 

AUD 

LL 

OB 

BI 

FF 

ST 

WF 

AF 

COG 

PSYM 

VIS 

1.2 

1.2 

Most  Likely  Time  to  Complete  (s) 

1.2 

1.0 

1.2 

Fastest  Time  to  Compete  (s) 

1.0 

.6 

1.0 

1 1 .  Proceed  (dummy) 
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Function  6:  Nothing  Happens  (dummy) 


Function  7:  Steer  Vehicle 
Tasks: 

1.  Steer  Vehicle  (dummy) 


2.  Steer  Right 

AUD 

LL 

OB 

BI 

FF 

ST 

WF 

AF 

COG 

1 

1 

1 

1 

1 

PSYM 

2.6 

2.6 

2.6 

2.6 

2.6 

VIS 

5.4 

3.7 

4 

5 

4 

Most  Likely  Time  to  Complete  (s) 

1.3 

1.0 

1.0 

Fastest  Time  to  Compete  (s) 

.95 

.8 

.8 

3.  Steer  Left 

AUD 

LL 

OB 

BI 

FF 

ST 

WF 

AF 

COG 

1 

1 

1 

1 

1 

PSYM 

2.6 

2.6 

2.6 

2.6 

2.6 

VIS 

5.4 

3.7 

4 

5 

4 

Most  Likely  Time  to  Complete  (s) 

1.3 

1.0 

1.0 

Fastest  Time  to  Compete  (s) 

.95 

.8 

.8 

4.  Hold  Straight 

AUD 

LL 

OB 

BI 

FF 

ST 

WF 

AF 

COG 

1 

1 

1 

1 

PSYM 

2.6 

2.6 

2.6 

2.6 

VIS 

5.4 

3.7 

4 

4 

Most  Likely  Time  to  Complete  (s) 

1.3 

1.0 

1.0 

Fastest  Time  to  Compete  (s) 

.95 

.8 

.8 

5.  Let  Steering  Self-Center 

AUD 

LL 

OB 

BI 

FF 

ST 

WF 

AF 

COG 

PSYM 

1 

1 

1 

VIS 

1 

4 

4 

Most  Likely  Time  to  Complete  (s) 

1.3 

1.0 

1.0 

Fastest  Time  to  Compete  (s) 

.95 

.8 

.8 

6.  Verify  Center  Position 

AUD 

LL 

OB 

BI 

FF 

ST 

WF 

AF 

COG 

PSYM 

6.8 

1 

6.8 

4.6 

4.6 

VIS 

5.4 

3.7 

4 

5 

4 

Most  Likely  Time  to  Complete  (s) 

2.5 

1.0 

1.5 

1.0 

Fastest  Time  to  Compete  (s) 

1.2 

.8 

1.2 

.8 

7.  Verify  Steering  Control  Action 

AUD 

LL 

OB 

BI 

FF 

ST 

WF 

AF 

COG 

PSYM 

4.6 

1 

4.6 

4.6 

VIS 

5.4 

3.7 

5 

5 

Most  Likely  Time  to  Complete  (s) 

2.0 

1.2 

1.2 

Fastest  Time  to  Compete  (s) 

1.2 

1.0 

1.0 
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Function  8:  Power  Vehicle 


Tasks: 

1.  Power  Vehicle  (dummy) 

2.  Accelerator  (dummy) 


Apply  Accelerator 

AUD 

LL 

OB 

BI 

FF 

ST 

WF 

AF 

COG 

1 

1 

PSYM 

2.6 

2.6 

VIS 

1 

1 

Most  Likely  Time  to  Complete  (s) 

1.3 

1.2 

1.3 

Fastest  Time  to  Compete  (s) 

1.0 

.6 

1.0 

Hold  Accelerator 

AUD 

LL 

OB 

BI 

FF 

ST 

WF 

AF 

COG 

1 

1 

PSYM 

2.6 

2.6 

VIS 

1 

1 

Most  Likely  Time  to  Complete  (s) 

1.3 

1.2 

1.3 

Fastest  Time  to  Compete  (s) 

1.0 

.6 

1.0 

Let  Off  Accelerator 

AUD 

LL 

OB 

BI 

FF 

ST 

WF 

AF 

COG 

1 

1 

PSYM 

2.6 

2.6 

VIS 

1 

1 

Most  Likely  Time  to  Complete  (s) 

1.3 

1.2 

1.3 

Fastest  Time  to  Compete  (s) 

1.0 

.6 

1.0 

Verify  Accelerator  Action 

LL 

OB 

BI 

FF 

ST 

WF 

AF 

AUD 

4.3 

1 

1 

COG 

PSYM 

4.6 

1 

3.7 

3.7 

VIS 

3.7 

3.7 

3.7 

3.7 

Most  Likely  Time  to  Complete  (s) 

1.3 

1.0 

1.0 

Fastest  Time  to  Compete  (s) 

.95 

.8 

.8 

Brake  (dummy) 

Most  Likely  Time  to  Complete  (s) 

1.3 

1.2 

Fastest  Time  to  Compete  (s) 

1.0 

.6 

Apply  Brake 

AUD 

LL 

OB 

BI 

FF 

ST 

WF 

AF 

COG 

1 

1 

PSYM 

2.6 

2.6 

VIS 

1 

1 

Most  Likely  Time  to  Complete  (s) 

1.3 

1.2 

1.3 

Fastest  Time  to  Compete  (s) 

1.0 

.6 

1.0 
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9.  Hold  Brake 

AUD 

LL 

OB 

B1 

FF 

ST 

WF 

AF 

COG 

1 

1 

PSYM 

2.6 

2.6 

VIS 

1 

1 

Most  Likely  Time  to  Complete  (s) 

1.3 

1.2 

1.3 

Fastest  Time  to  Compete  (s) 

1.0 

.6 

1.0 

10.  Let  Off  Brake 

AUD 

LL 

OB 

B1 

FF 

ST 

WF 

AF 

COG 

1 

1 

PSYM 

2.6 

2.6 

VIS 

1 

1 

Most  Likely  Time  to  Complete  (s) 

1.3 

1.2 

1.3 

Fastest  Time  to  Compete  (s) 

1.0 

.6 

1.0 

11.  Verify  Brake  Action 

LL 

OB 

B1 

FF 

ST 

WF 

AF 

AUD 

4.3 

1 

1 

COG 

PSYM 

4.6 

1 

3.7 

3.7 

VIS 

3.7 

3.7 

3.7 

3.7 

Most  Likely  Time  to  Complete  (s) 

1.3 

1.0 

1.3 

Fastest  Time  to  Compete  (s) 

.95 

.8 

.8 
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2  ADMINISTRATOR 

DEFENSE  TECHNICAL  INFO  CENTER 
ATTN  DTIC  DDA 

8725  JOHN  J  KINGMAN  RD  STE  0944 
FTBELVOIR  VA  22060-6218 

I  DIRECTOR 

US  ARMY  RESEARCH  LABORATORY 
ATTN  AMSRLOPSDTA/ 

RECORDS  MANAGEMENT 
2800  POWDER  MILL  RD 
ADELPHIMD  20783-1197 

I  DIRECTOR 

US  ARMY  RESEARCH  LABORATORY 
ATTN  AMSRLOPSDTL/ 

TECHNICAL  LIBRARY 
2800  POWDER  MILL  RD 
ADELPHIMD  207830-1197 

I  DIRECTOR 

US  ARMY  RESEARCH  LABORATORY 
ATTN  AMSRLOPSDTP/ 

TECH  PUBLISHING  BRANCH 
2800  POWDER  MILL  RD 
ADELPHIMD  20783-1197 

I  DIRECTORATE  FOR  MANPRINT 

ATTN  DAPEMR 

DEPUTY  CHIEF  OF  STAFF  PERSONNEL 
300  ARMY  PENTAGON 
WASHINGTON  DC  20310-0300 

I  CODEII42PS 

OFFICE  OF  NAVAL  RESEARCH 
800  N  QUINCY  STREET 
ARLINGTON  VA  22217-5000 

I  DR  ARTHUR  RUBIN 

NATL  INST  OF  STANDARDS  &  TECH 
BUILDING  226  ROOM  A3 1 3 
GAITHERSBURG  MD  20899 

I  COMMANDER 

US  ARMY  RESEARCH  INSTITUTE 
ATTN  PERI  ZT  (DR  E  M  JOHNSON) 
5001  EISENHOWER  AVENUE 
ALEXANDRIA  VA  22333-5600 

I  DEPUTY  COMMANDING  GENERAL 

ATTN  EXS  (Q) 

MARINE  CORPS  RD&A  COMMAND 
QUANTICO  VA  22134 


I  HEADQUARTERS  USATRADOC 

ATTN  ATCDSP 
FORT  MONROE  VA  23651 

I  COMMANDER 

USATRADOC 

COMMAND  SAFETY  OFFICE 

ATTN  ATOS  (MR  PESSAGNO/MR  LYNE) 

FORT  MONROE  VA  23651-5000 

I  COMMANDER 

US  ARMY  MATERIEL  COMMAND 
ATTN  AMCAM 
5001  EISENHOWER  AVENUE 
ALEXANDRIA  VA  22333-0001 

I  COMMANDER 

USA  OPERATIONAL  TEST  &  EVAL  AGENCY 
ATTN  CSTETSM 
4501  FORD  AVE 
ALEXANDRIA  VA  22302-1458 

I  USA  BIOMEDICAL  R&D  LABORATORY 

ATTN  LIBRARY 
FORT  DETRICK  BUILDING  568 
FREDERICK  MD  21702-5010 

I  HQ  USAMRDC 

ATTN  SGRDPLC 
FORT  DETRICK  MD  2 1 70 1 

I  COMMANDER 

USA  AEROMEDICAL  RESEARCH  LAB 

ATTN  LIBRARY 

FORT  RUCKER  AL  36362-5292 

I  US  ARMY  SAFETY  CENTER 

ATTN  CSSC  SE 
FORT  RUCKER  AL  36362 

I  CHIEF 

ARMY  RESEARCH  INSTITUTE 
AVIATION  R&D  ACTIVITY 
ATTN  PERIIR 

FORT  RUCKER  AL  36362-5354 

I  TECHNICAL  INFORMATION  CENTER 

HQS  TRADOC  TEST  &  EXPERIMENTATION 
CMD  EXPERIMENTATION  CENTER 
BLDG  2925 

FORTORD  CA  93941-7000 
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I  AAMRL/HE 

WRIGHT  PATTERSON  AFB  OH 
45433-6573 

I  US  ARMY  NATICK  RD&E  CENTER 
ATTN  STRNCYBA 
NATICK  MA  01760-5020 

I  US  ARMY  TROOP  SUPPORT  CMD 

NATICK  RD&E  CENTER 
ATTN  BEHAVIORAL  SCI  DIV  SSD 
NATICK  MA  01760-5020 

I  US  ARMY  TROOP  SUPPORT  CMD 

NATICK  RD&E  CENTER 
ATTN  TECH  LIBRARY  (STRNC  MIL) 
NATICK  MA  01760-5040 

1  HQ  USA  RESEARCH  INST  OF 

ENVIRONMENTAL  MEDICINE 
ATTN  MEDRI  CL  (DR  J  KOBRICK) 
NATICK  MA  01760-5007 

I  DR  RICHARD  JOHNSON 

HEALTH  &  PERFORMANCE  DIVISION 
US  ARIEM 

NATICK  MA  01760-5007 

I  USAF  ARMSTRONG  LAB/CFTO 

ATTN  DR  F  WESLEY  BAUMGARDNER 
SUSTAINED  OPERATIONS  BRANCH 
BROOKS  AFB  TX  78235-5000 

I  DR  JON  FALLESEN 

ARI  FIELD  UNIT 
PO  BOX  3407 

FORT  LEAVENWORTH  KS  66027-0347 

I  ARI  FIELD  UNIT  FORT  KNOX 

BUILDING  2423  PERI  IK 
FORT  KNOX  KY  40121-5620 

I  COMMANDANT 

USA  ARTILLERY  &  MISSILE  SCHOOL 
ATTN  USAAMS  TECH  LIBRARY 
FORT  SILL  OK  73503 

I  COMMANDER 

WHITE  SANDS  MISSILE  RANGE 

ATTN  STEWS  TE  RE 

WHITE  SANDS  MISSILE  RANGE  NM 

88002 


I  COMMANDER 

WHITE  SANDS  MISSILE  RANGE 
ATTN  TECHNICAL  LIBRARY 
WHITE  SANDS  MISSILE  RANGE  NM 

88002 

I  STRICOM 

12350  RESEARCH  PARKWAY 
ORLANDO  EL  32826-3276 

I  COMMANDER 

USA  TANK- AUTOMOTIVE  R&D  CENTER 
ATTN  AMSTA  RS/D  REES 
WARREN  MI  48090 

I  COMMANDER 

USA  TANK- AUTOMOTIVE  R&D  CENTER 
ATTN  AMSTA  TSL  (TECH  LIBRARY) 
WARREN  MI  48397-5000 

I  COMMANDER 

USA  COLD  REGIONS  TEST  CENTER 
ATTN  STECR  TS  A 
APO  AP  96508-7850 

I  US  ARMY  RSCH  DEV  STDZN  GP-UK 

ATTN  DR  MIKE  STOUT 
PSC  802  BOX  15 
FPOAE  09499-1500 

I  PURDUE  UNIVERSITY 

SERIALS  UNIT 
CDM  KARDEX 
1535  STEWART  CENTER 
WEST  LAFAYETTE  IN  47907-1535 

I  GOVT  PUBLICATIONS  LIBRARY 

409  WILSON  M 

UNIVERSITY  OF  MINNESOTA 
MINNEAPOLIS  MN  55455 

I  DR  HARVEY  A  TAUB 

RSCH  SECTION  PSYCH  SECTION 
VETERANS  ADMIN  HOSPITAL 
IRVING  AVENUE  &  UNIVERSITY  PLACE 
SYRACUSE  NY  I32I0 

I  DR  ANTHONY  DEBONS 

IDIS  UNIVERSITY  OF  PITTSBURGH 
PITTSBURGH  PA  15260 

I  DR  ROBERT  KENNEDY 

ESSEX  CORPORATION  SUITE  227 
1040  WOODCOCK  ROAD 
ORLANDO  EL  32803 
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I  DR  NANCY  ANDERSON 

DEPARTMENT  OF  PSYCHOLOGY 
UNIVERSITY  OF  MARYLAND 
COLLEGE  PARK  MD  20742 

I  MR  LARRY  W  AVERY 

BATTELLE  PACIFIC  NW  LABS 
PO  BOX  999  MAIL  STOP  K6-66 
RICHLAND  WA  99352 

I  LIBRARY 

ESSEX  CORPORATION 
SUITE  510 

1430  SPRING  HILL  ROAD 
MCLEAN  VA  22102-3000 

I  DR  BEN  B  MORGAN 

DEPARTMENT  OF  PSYCHOLOGY 
UNIVERSITY  OF  CENTRAL  FLORIDA 
PO  BOX  25000 
ORLANDO  EL  32816 

I  LAWRENCE  C  PERLMUTER  PHD 

UNIV  OF  HEALTH  SCIENCES 
THE  CHICAGO  MEDICAL  SCHOOL 
DEPT  OF  PSYCHOLOGY 
3333  GREEN  BAY  ROAD 
NORTH  CHICAGO  IL  60064 

I  MR  AJ  ARNOLD  STAFF  PROJECT  ENG 

HUMAN  FACTORS  DEPARTMENT 
GENERAL  MOTORS  SYSTEMS  ENG 
1 15 1  CROOKS  ROAD 
TROY  MI  48084 

I  GENERAL  DYNAMICS 

LAND  SYSTEMS  DIV  LIBRARY 
PO  BOX  1901 
WARREN  MI  48090 

I  DR  LLOYD  A  AVANT 

DEPARTMENT  OF  PSYCHOLOGY 
IOWA  STATE  UNIVERSITY 
AMES  I A  50010 

I  DRMMAYOUB  DIRECTOR 

INST  FOR  ERGONOMICS  RESEARCH 
TEXAS  TECH  UNIVERSITY 
LUBBOCK  TX  79409 

I  MR  KENNETH  C  CROMBIE 

TECHNICAL  LIBRARIAN  El 04 
DELCO  SYSTEMS  OPERATIONS 
6767  HOLLISTER  AVENUE 
GOLETA  CA  931 17 


I  MR  WALT  TRUSZKOWSKI 
CODE  522.3 

NASA/GODDARD  SPACE  FLIGHT  CENTER 
GREENBELT  MD  20771 

I  DR  TOM  MALONE 

CARLOW  ASSOCIATES  INC 
SUITE  750 

3141  FAIR  VIEW  PARK  DRIVE 
FAIRFAX  VA  22042 

I  COMMANDER 

US  ARMY  RESEARCH  INSTITUTE 
OF  ENVIRONMENTAL  MEDICINE 
NATICK  MA  01760-5007 

I  DR  DANIEL  J  POND 

BATTELLE  PNL/K6-66 
PO  BOX  999 
RICHLAND  WA  99350 

I  HUMAN  FACTORS  ENG  PROGRAM 

DEPT  OF  BIOMEDICAL  ENGINEERING 
COLLEGE  OF  ENGINEERING  & 
COMPUTER  SCIENCE 
WRIGHT  STATE  UNIVERSITY 
DAYTON  OH  45435 

I  PEO  ARMORED  SYS  MODERNIZATION 

US  ARMY  TANK- AUTOMOTIVE  CMD 
ATTN  SEAL  ASMS 
WARREN  MI  48397-5000 

I  PEO  COMBAT  SUPPORT 

ATTN  AMCPEOCS 
US  ARMY  TANK  AUTOMOTIVE  CMD 
WARREN  MI  48397-5000 

I  PEO  INTELLIGENCE  &  ELECTRONIC 

WARFARE 
ATTN  AMCPEOIEW 
VINT  HILL  FARMS  STATION  BLDG  197 
WARRENTON  VA  22186-51 15 

I  DENNIS  L  SCHMICKLY 

CREW  SYSTEMS  ENGINEERING 
MCDONNELL  DOUGLAS  HELICOPTER 
5000  EAST  MCDOWELL  ROAD 
MESA  AZ  85205-9797 

I  JON  TATRO 

HUMAN  FACTORS  SYSTEM  DESIGN 
BELL  HELICOPTER  TEXTRON  INC 
PO  BOX  482  MAIL  STOP  6 
FT  WORTH  TX  7610 1 
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CHIEF  CREW  SYSTEMS  INTEGRATION  I 

SIKORSKY  AIRCRAFT  M/S  S3258 
NORTH  MAIN  STREET 
STRATFORD  CT  06602 

OASD  (FM&P) 

WASHINGTON  DC  20301-4000  I 

COMMANDER 

MARINE  CORPS  SYSTEMS  COMMAND 
ATTN  CBGT 

QUANTICO  VA  22134-5080  I 

DIRECTOR  AMC-FIELD  ASSIST  IN 
SCIENCE  &  TECHNOLOGY 
ATTN  AMC-FAST  (RICHARD  FRANSEEN) 

FT  BEL  VOIR  VA  22060-5606 

I 

COMMANDER 

US  ARMY  FORCES  COMMAND 
ATTN  FCDJ  SA  BLDG  600 
AMC  FAST  SCIENCE  ADVISER 
FT  MCPHERSON  GA  30330-6000 

I 

COMMANDER 
I  CORPS  AND  FORT  LEWIS 
AMC  FAST  SCIENCE  ADVISER 
ATTN  AFZHCSS 
FORT  LEWIS  WA  98433-5000 

I 

HQ  III  CORPS  &  FORT  HOOD 
OFFICE  OF  THE  SCIENCE  ADVISER 
ATTN  AFZF  CS  SA 
FORT  HOOD  TX  76544-5056 

COMMANDER  I 

U.S.  ARMY  NATL  TRAINING  CENTER 
AMC  FAST  SCIENCE  ADVISER 
ATTN  AMXLASA 
FORT  IRWIN  CA  92310 

COMMANDER  I 

HQ  XVIII  ABN  CORPS  &  FORT  BRAGG 
OFFICE  OF  THE  SCI  ADV  BLDG  I-I62I 
ATTN  AFZAGDFAST 
FORT  BRAGG  NC  28307-5000 

SOUTHCOM  WASHINGTON  FIELD  OFC  I 

1919  SOUTH  EADS  ST  SUITE  L09 
AMC  FAST  SCIENCE  ADVISER 
ARLINGTON  VA  22202 

I 


HQ  US  SPECIAL  OPERATIONS  CMD 
AMC  FAST  SCIENCE  ADVISER 
ATTN  SOSD 

MACDILL  AIR  FORCE  BASE 
TAMPA  EL  33608-0442 

HQ  US  ARMY  EUROPE  AND  7TH  ARMY 
ATTN  AEAGXSA 
OFFICE  OF  THE  SCIENCE  ADVISER 
APOAE  09014 

COMMANDER 

HQ  2IST  THEATER  ARMY  AREA  CMD 
AMC  FAST  SCIENCE  ADVISER 
ATTN  AERSA 
APOAE  09263 

COMMANDER 
HEADQUARTERS  USEUCOM 
AMC  FAST  SCIENCE  ADVISER 
UNIT  30400  BOX  138 
APOAE  09128 

HQ  7TH  ARMY  TRAINING  COMMAND 
UNIT  #28130 

AMC  FAST  SCIENCE  ADVISER 
ATTN  AETTSA 
APOAE  091 14 

COMMANDER 

HHC  SOUTHERN  EUROPEAN  TASK  FORCE 
ATTN  AESE  SA  BUILDING  98 
AMC  FAST  SCIENCE  ADVISER 
APOAE  09630 

COMMANDER 
US  ARMY  PACIFIC 
AMC  FAST  SCIENCE  ADVISER 
ATTN  APSA 

FT  SHATTER  HI  96858-5L00 

COMMANDER 
US  ARMY  JAPAN/IX  CORPS 
UNIT  45005  ATTN  APAJ  SA 
AMC  FAST  SCIENCE  ADVISERS 
APOAP  96343-0054 

AMC  FAST  SCIENCE  ADVISERS 
PCS  #303  BOX  45  CS-SO 
APO  AP  96204-0045 

COMMANDER  ALASKAN  COMMAND 
ATTN  SCIENCE  ADVISOR  (MR  GRILLS) 
6-900  9THSTSTE  1 10 
ELMENDORFAFB  ALASKA  99506 
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